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ABSTRACT 

The present paper reviews the techniques commonly 
used to correct an observed correlation coefficient for the 
simultaneous influence of attenuation and range restr icti on ^effects . 
It is noted that the procedure which is currently in use may be y 
somewhat biased because it treats range restriction and attenuation 
as independent restrictive influences. Subsequently, an equation was 
derived which circumvents this difficulty and provides a more general 
solution to the problem of estimating the true magnitude of a 
correlation coefficient in data sets where these restrictive 
influence** are operating. Finally, the nature of the bias induced by 
application of the common corrective technique is identified and, 
related to the equation derived in the study at hand. (Author) 
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^Abstract 



The present p^per reviews the teplmiques comjb^nly used to correct an v 

observed correlation coefficient for the simultaneous influence of attenua- 

/ 

tion and fange restriction effects. It is noted that the procedure which is 

curj^ntly in use may be somewhat biased because it treats range restriction 

/ 

knd attenuation as independent restrictive influences. Subsequently, an 
equation was derived which circumvents this dif ficulty and provides a more 
general solution to the problem of estimating the true magnitude of a corre- 
lation coefficient in data sets where these restrictive influences are 

operating. Finally, the n&ture of the bias induced by application of the 

^ 1 
common corrective technique is identified and relate^ to the equation 

derived in the study at hand. 
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One of the most pervasive methodological problems facing psychologists 
entails determination of the techniques vhich are to be uSed in assessing 
the nature and strength of the relationship between various measures. Of 
course, the correlation coefficient has provided the field with a viable 
statistical tool for solving this problem in the univariate case. Unfor- 
tunately, in some instances the appropriateness of correlational techniques 
may be limited by the operation of certain statistical biases in actual 
data bases. Thomdike (1949) has noted that two of these biases, termed 
range restriction and attenuation effects, can exert a powerful diminishing 
influence on the magnitude of observed correlation coefficients. Range 
restriction occurs when the variability in a sample is reduced on one or 
more measures relative to that observed in the target population, as a result 
of the operation of spurious influences such as prior selection on an un^ 
measured but positively correlated extraneous variable. The net effect of 
range restriction is a reduction in the expected magnitude of the observed 
correlation cbefficient and an underestimate of the true relationship between 
the variables. Attenuation effects refer to the fact that an observed 
correlation coefficient will tend to underestimate the true magnitude of the 
relationship between two variables to th/ extent that these measures are not 



an accurate reflectioii^Q^/true variation, i.e., to the extent that they are 
unreliable. In some applied studies the operation of these biases may be 
acceptable. Yet when an investigation centers on determining the true 
strength of the relationship between two sets of measures the operation of 
these biases in the experimental data base constitutes a serious, often un- 
avoidable, confound. / 

Fsychometrics has long been cognizant of the implications of range 
restriction and attenuation effects with respect to the infefccenriSpdrawn by 
investigators contending the magnitude of relationships. Consequently , a 
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variety of equations have been derived which permit the investigator *to correct 
data based estimates of the magnitude of a correlation coefficient for the 
operation of these influences (Guilford, 1954; Stanley, 1971) • However, these 
equations were designed to correct an observed coeffieient for the operation 
of a single biasing influence* When a researcher is concerned with deter- 
mining the magnitude of a relationship irrespective of both those range res- 
triction and attenuation Effects which may be operating, the folloving e procedure is 
generally utilized* Initially, the observed correlation coefficient is cor- 
rected for attenuation in the predictor and/or criterion measures via this . * 
formula 

— ^ — 

cA 



r 

yy 



where: 



r c the correlation between the predictor and criterion corrected for 
attenuation 

r, m the observed correlation between the bredictor and criterion 

r xx * the " liabilit y of the predictor 
■ - the reliability of the criterion. 
Once r cA has been obtained, this term* is entered into the particular equation 
correcting for the effects of range restriction which is appropriate with res- 
pect to the methodological situation at hand. In those cases w&ere range 

\ ■ " .x 

restriction has occurred because of prior selection on the basis, of .predictor 

scores, Thorndike's Type II, the following equation would be used, 

i 

r cA . 6x(R) 



V cA. cA ( — = — ) 

£ T x >- 

where: 

r C KA m the correlation between the predictor and criterion corrected for 
attenuation, and range restriction c 
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2 

6 / \ * the variance of the predictor in the restricted sample 
x(R) 

2 I 
6 - the variance of the predictor in the unrestricted sample 

x * 

^x(R) * t * ie stanc * arc * deviation of the predictor in the restricted sample 
6^ * the standard deviation of the predictor in the unrestricted sample 
t While the correction of an observed correlation coefficient for the ef fee 
of range restriction and attenuation through the use of this sequential strata 
has seen wide application in both theoretical and applied studies, the appropr 
ness of this procedure is dpeti^to question on the basis of at least three cons 
derations. First, application of the sequential strategy implicity assumes 
that range restriction and attenuation opeiyate as independent biasing effects. 
However, as Magnusson (1966) has pointed out, because range restriction acts 
to reduce true variation while leaving error variance constant, it tends to 
deflate reliability as well as validity estimates. The implication here is 
that range restriction and attenuation represent correlated rather than inde- 
pendent biasing effects. This in turn suggests, that the sequential correctio 
strategy outlined above yields a biased estimate of the true magnitude of the 
relationship between a predictor and criterion. Second, implementations of fh 
sequential strategy generally utilize only one of the special case corrections^ 
for range restriction, and since multiple types of Restriction may operate in 
study, application of this strategy can result in some degree of underestimati 
of the true strength of the predictor, criterion relationship. It is of note * 
that this observation indicates the need for a more general solution. Finally 
all corrections for range restriction assume that the slope of the best fittin 
regression line between the predictor and criterion measures^ is identical in 
both the restricted and unrestricted samples, (Ghiselli, Campbell and Zedeck, 
1981). To the extent range restriction operates to reduce true score varijatio 
while the error variance remains Constant, this assumption will only rarely be 

met since b * f *f^. This, suggests the presence of a further biasing influen 

xy ox _ 
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in the sequential strategy and current corrections for range restriction. 

Any bias arising from the foregoing assumptional violation may be elimi- 
nated if it is assumed that the regression of predictor true scores on criterion 
true scores is constant within both the restricted and the unrestricted samples. 
In the present paper an attempt was made to utilize this assumption in order to 
to derive a general solution for correcting an observed correlation coefficient 
for the simultaneous operation of attenuation and multiple range restriction 
effects. Additionally, an attempt was made to demonstrate the nature of the 
bias which arises through application of the sequential correction strategy. 

The assumption of a constant true score regression t line between the 
predictor and criterion measures, regardless of the degree and kind of range 
restriction, implies that the correlation between true scores within the res- 
tricted and unrestricted samples may be determined through the following equa- 

tions, under conditions of linearity, normality and homoscedacity of true scores; 

2 2 

(1A) 4ty- b txty^ (1B) 4y(R)-4y^ 

6 ty ^ 6 ty(R) 

wnere : 

2 

b « the square of the regression of true predictor scores on true 
criterion scores 

2 

r ■ the square of the correlation between predictor and criterion 
true scores in the unrestricted sample 

r 2 

txty(R) « the square of the correlation between predictor and criterion 
true stores in the restricted sample 

2 

6 tx ■ the variance of true scores on the predictor in the unrestricted sample 
6 2 

tx ■ the variance of true scores on the criterion in the unrestricted sample 
2 

^tx(R) " t * ie variance °f true scores on the predictor in the restricted sample 
6 2 

tx(R) ■ the variance of true scores on the criterion in the restricted sample 
Simple algebraic transformation of equations (1A) and (IB) yields 

(2A) b txty " r txty (2B) b 2 - r 2 ,*>6 2 , B , 

. J txty txty( R) ty(R) 

fi 2 o fi 2 

tx O °tx(R). 
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According to our initial assumption this implies that 

2 2 

(3 ) r 2 ..t£L r 2 . VttO 

w txty ,2 r txty(R) ,2 

6 tX 6 tX(R); 

which in turn leads to the following expressions 



6 2 6 2 



(AA) r 2 - r 2 . • tx(R) 

k ; r txty(R) r txty ,2 ,2 

6 tx 6 ty(R) 



2 2 

(4B) r 2 «r 2 ■ JE* . 6 ty(R) 

KHDJ r txty r txty(R) .2 2 

°ty °tx(R). 

Equations (4A) and (4B) specify the relationships between true score cor- 
relations obtained for two measures in a restricted and unrestricted sample, 
regardless of the degree and kind of range restriction. In the present inves- 
tigation equation (4B) is of particular interest since it specifies the formula 

I 

for simultaneously estimating the unattenuated, unrestricted correlation .v 

between a predictor and criterion measure on the basis of data obtained within 

the restricted sample and knowledge of the variance of these measures within 

the unrestricted sample. However, this equation has little practical value 

in the assessment of the true strength of the relationship between predictor 

and criterion scores since the right hand terms are expressed as a function 

of unobservable true scores. An initial step in eliminating this difficulty 

may be taken by rewriting the true score variances contained in equation (4B) 

in terms of the relevant observed variances and reliability coefficients. This 

substitution yields the following equation 
* 

r 6 2 r *6 2 



(5) r 2 . r 2 . J°L* . ^yy(R) w y(R) 
K3J r txty . r txty<R) m A 2 £ 2 

.. v. . 1 



r yy 6 y r xx(R) 6 x(R>; 
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which when rearranged leads to 



W tXty r t«y(R) ryy rjcx(R) 6 2 fi 2 



2 6 2 
x 

2 

y °x(R), 



where r and r are the reliabilities of the predictor anil criterion measures 
xx yy 

in the unrestricted sample, and r /t)N and r /t) * reflect the reliabilities of 

these measures in the restricted sample* At this point there remains only the 

2 

question as to how the term r. . /t) * can be estimated from observable relation- 

txty \&) 

ships. This issue can be resolved by noting that the correlation observed in 
a restricted sal^le is defined by the equation 

b 2 • 6 4 
, m 2 b txty °tx(R) 

(7) r xy(R) 6 2 . 6 2 

since cov 2 (x,y)R - cov (tx.ty^R - b 2 xty(R) 6^ (R) and b 2 xty(R) - b 2 ^ 

2 2 

Multiplying both sides of equation (7) by 6 tx ( R ) . 6 t y(R) and simplifying, , 



one obtains 2 
w r txty(R) 



2 2 
6 tx(R) 6 ty(R) 



r xx(R) ' r yy(R) 



2 

When the foregoing expression is substituted into equation (6) T txt y *&ay be 



rewritten as 



< 9 > 4ty 



r xy(R) ./fxx] ' / r yy(R) N ' Y 6 y(R)] -/ 6 x \ 

r xx(R) ' r yy(R) V r J l r yy / \ 6 y / l 6 x(R)J. 



Equation (9) presents the formula for the simultaneous correction of atten- 
uation and range restriction effetftfe on the basis of observable information. 
*Most of the statistical information required for implementation of this equation 
should be readily available to the investigator. The variance of scores on the 
predictor and criterion within the sample being examined in the research effort 
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may be used as estimates of the restricted variances of these measures. Esti- 
mates of the unrestricted variance of the predictor and criterion measures, 
as veil as theij^ unrestricted reliabilities, may be obtained from the standard * 
sources of normative information. The only parameters required by this equation 
which might not be available are the estimates of the reliability of the 
predictor and criterion measures, because investigators commonly make no attempt 
to obtain this information. However, the lack of direct estimates for these 
two parameters does not necessarily preclude the use of equation (9) if it is 
assumed that the standard error of measurement, or the variance ax^und a true 
score, is constant in both the restricted and unrestricted samples on the 
predictor and criterion measures. Under these conditions the restricted 
reliabilities may be estimated by the following formulas 



(10) r xx(R) " 1 1"^— 



x(R) 
* 6 y(R> 

Thus the restricted reliabilities of the predictor and criterion measures can 
be estimated from data readily available to the investigator. As a result, it 
appears that there are no serious impediments to the use of equation (9) in 
correcting correlation coefficients for the operation of attenuation and range 
restriction effects. 

v 

Because it appear^ ^hat, It is possible to implement equation (9) in prac- 
tice, it now seems appropriate to examine the relationship between this formula 
and the traditional sequential procedure. While the particular order in which 
the steps of the sequential are carried out is of little import, we will begin 
with the general correction for range restriction (e.g., see Gishelli, Campbell, 
and Zedeck, 1981) ; which specifies that 

ERJO " 11 
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2 2 

(12 ) r 2 . r 2 . _2l£L fx 
{12) r cR r xy(R) ' 2 ' 2 

6 x(R) 6 y , 

2 

vhere r ^ denotes the square of the predictor criterion correlation coefficient 

/ CK 

corrected for range restriction. Multiplying both sides of equation (12) by 
6 tx 6 .t 

— r— * an< j employing equation (7) the following expressions are obtained 

ty tx 

• b 2 A ,2 ,2 ,1 

2 txty * tx x . tx . ty 
UJA; r cR ,4 • ,2 *2 ,2 

6 x(R) * 6 y 6 .ty 6 tx 

n ty • tx x(R) y 

6 

2 tx 2 

Since b^ ^ — =— m r^ _ . substitution and rearrangement results in the ex- 
txty • r 2 txty* & 

pression* /^T^ ' 

XX » 

Equation (14) presents the correlation coefficient corrected for % range restric- 
tion. Nov correcting both sides of equation (14) for attenuation yields 

. 1 

2 # 2 ^yy 2 — - 

(15) r cR ' r xx(R) ' r yy(R) * * r txty ' ( r ) 9 r xx(R) ' r xx(R) r yy(R) 

xx 

if r 2 5 /. , 

cRA is used to designate v the square of the fully corrected sequential coef- 
ficient, then equation (15) may be simplified to the following expressions 



(16A) cRA r txty ' ( — ) * " 

xx r yy(R) 

(16B) r^-r 2 ^. ( !xx } . fy^ 

• r yy' r xx(R) . 



12 . k - 
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Earliet it was noted that oiir central concern in carrying out.. corrections 

for range restriction and attenuation is the reproduction of the true magnitude 

of the relationship between predictor and criterion scores after the'effects 

of range restriction and attenuation have been removed. However, as equation 

(16B) demonstrates the sequential correction procedure will produce an esti- 

r r 

mate of r\ which differs systematically from r^ by a factor of -~ . WW ' 

txty cxcy yy r xx(R) . 

This implies that the sequential correction procedure will yield a biased 

2 r r 

Estimate of r except in those rare cases where xx yy(R) is equal to 

\ tXty r yy ' r xx(R) 

one; that is, when there are no range restriction effects or the predictor and 
criterion measures are of equal reliability in both the restricted and un^es- 
tricted samples. Whether r is overestimated or underestimated will depend 

/ 

on the particular combinatidfi of predictor and criterion reliabilities obtained 
in the restricted and unrestricted samples. Yet it is of note that this bias 
can be substantial. For instance, if the unrestricted reliability of the 
predictor is .85, the unrestricted reliability of the criterion is .70 and 
there is a 33% restriction of range soley on the criterion measure, then' appli- 
cation of the sequential correction strategy will yield a T^fc overestimate of 
r^ . Since the foregoing example is a reasonably realistic presentation of 

the conditions observed in the selection situation, it seems clear that appli- 

2 ' 

cation of the sequential strategy can yield an estimate of which is suf- 

ficiently biased to be a cause for concern. Of course, equation (16B) may be 

2 • r 2 

used to remove this bias. However, since r fiRA is equal to xy<R) 



r xx(R)- yy(R) 



6 2 6 2 

bus..*.*. 



2 2 

6 6 , this correction will yield the equation 

x y *w < 

2 2 

r 2 Vai) . S(K> . ^ . ^ . "yy(K 

ERIC . " txty r ««> ' 6 l 6 lm T T> ' 

12. 
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which is equivalent to equation (9) or the formula for the simultaneous cor- ^ 

rection of range restriction and attenuation effects. 

Given the evidence presented in the foregoing paragraphs for the biased 

2 

nature of the estimates of obtained from the sequential correction pro- 

cedure, it would seem that this technique should be replaced with the formula 

for the simultaneous correction of range restriction and attenuation effects. 

2 

The simultaneous procedure should produce a sounder estimate of r txt y« Addi- 
tionally, the simultaneous procedure appears to offer a somewhat more general 
solution to the problem of estimating the true magnitude of the relationship 
between two measures. This technique is capable of incorporating multiple 
specific range restriction effects and its derivation does not assume trun- 
cation. . Moreover, this equation can be applied regardless of the particular 
degree of attenuation and/or range restriction operating on the predictor and/ 
or criterion measures. For example, when there is no restriction of scores 

on the predictor and criterion measures, the simultaneous equation will be 

2 

reduced to the traditional correction for attenuation; that is, r xy(R) 



ScrOO - r yy(R) 

Finally, it should be noted that the nature of the simultaneous equation 
suggests that any attempt to correct for both range restriction and attenuation 
effects, when estimating the true magnitude of a relationship, must incorporate 
the fact that range restriction and attenuation are interactive biasing influ- 
ences. 



14 



-at- 



Bias Corrections 
11 

References 

Ghiselli, E. E. , Campbell, J, P., and Zedeck, S. Measurement Theory for the 
Behavioral Sciences . San Francisco, California; W. H. Freeman and Co., 
■ 1981. - .... ^ 

Guilford, J. P. Psychometric Methods . New York; McGraw-Hill Inc., 1954. 
Magnusson, D. Test Theory . Reading, Massachusetts; Addison-Weseley Inc., 1966. 
Stanley, J. C. Reliability. In R. L. Thorndike (Ed.), Educational Measurement . 

Washington D. C; American Council on Education, 1971. 
Thorndike, R. L. Personnel Selection: Test and Measurement Techniques . New 

York; Wiley, 1949. 



